Palette coding for screen content coding

ABSTRACT

Video data may be palette decoded. Data defining a palette table may be received. The palette table may comprise index values corresponding to respective colors. Palette index prediction data may be received and may comprise data indicating index values for at least a portion of a palette index map mapping pixels of the video data to color indices in the palette table. The palette index prediction data may comprise run value data associating run values with index values for at least a portion of a palette index map. A run value may be associated with an escape color index. The palette index map may be generated from the palette index prediction data at least in part by determining whether to adjust an index value of the palette index prediction data based on a last index value. The video data may be reconstructed in accordance with the palette index map.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.16/250,064, filed Jan. 17, 2019, which is a continuation of U.S. patentapplication Ser. No. 14/658,989, filed Mar. 16, 2015, Issued as U.S.Pat. No. 10,237,575, which claims the benefit of U.S. Provisional PatentApplication No. 61/953,700, filed Mar. 14, 2014, and U.S. ProvisionalPatent Application No. 62/041,043, filed Aug. 23, 2014, the disclosuresof which are incorporated herein by reference in their entirety.

BACKGROUND

Screen content sharing applications have become very popular in recentyears with the increased popularity of remote desktop, videoconferencing, and mobile media presentation applications. There may beapplication requirements from industries. Screen content may refer tovideo that may not be part of a natural video scene. Screen content mayinclude, for example, outlines (e.g., to visually separate two separatepictures shown simultaneously on a monitor), words, line drawings, etc.Screen content may include numerous blocks with a few major colors andsharp edges due to a prevalence of sharp curves, text, and the like inthe video content.

Video compression methods may be used to encode screen content. Manyexisting compression methods do not fully characterize the features ofscreen content, which may lead to inefficient compression performance.Furthermore, the reconstructed picture at the receiver may have qualityissues. For example, the curves and texts may be blurred and difficultto recognize.

Video compression methods that are efficient for screen content codingare becoming increasingly important because more and more people aresharing their device content for media presentations and remote desktoppurposes. Furthermore, screen display resolution of mobile devices hassubstantially increased to high definition or ultra-high definitionresolutions. Video coding tools, such as block coding modes andtransform, may not be optimized for screen content encoding and mayincrease the bandwidth consumption for transmitting screen content.

SUMMARY

Methods, systems, and instrumentalities are disclosed for palettedecoding video data, e.g., screen content video data. Data defining apalette table may be received. The palette table may comprise aplurality of index values corresponding to respective colors of aplurality of colors. Palette index prediction data may be received. Thepalette index prediction data may comprise data that may indicate indexvalues for at least a portion of a palette index map that may map one ormore pixels of the video data to one or more color indices in thepalette table. The palette index map may be generated from the paletteindex prediction data at least in part by determining whether to adjustan index value of the palette index prediction data based on a lastindex value. The video data may be reconstructed in accordance with thepalette index map.

Video data may be palette coded by producing a palette table comprisinga plurality of color indices corresponding to respective colors of aplurality of colors. A palette index map may be created. The paletteindex map may map one or more pixels of the video data to one or morecolor indices in the palette table. Palette index prediction data may begenerated based on the palette index map. The palette index predictiondata may comprise data that may indicate index values for at least aportion of the palette index map. Generating the palette indexprediction data may include determining whether to adjust an index valueof the palette index map based on a last index value.

Data defining a palette table may be received. The palette table maycomprise a plurality of color index values corresponding to respectivecolors of a plurality of major colors. A palette index prediction datamay be received. The palette index prediction data may comprise runvalue data that may associate run values with index values for at leasta portion of a palette index map. At least one run value may beassociated with an escape color index. At least a portion of the videodata may be reconstructed in accordance with the palette table, thepalette index prediction data, and the palette index map.

Video data may be palette coded by producing a palette table that maycomprise a plurality of color indices corresponding to respective colorsof a plurality of major colors. A palette index map may be created. Thepalette index map may map a pixel of the video data to a color index inthe palette table if a color of the pixel is associated with a majorcolor. The palette index map may map the pixel of the video data to anescape color index if the color of the pixel is not associated with amajor color. Palette index prediction data may be generated based on thepalette index map. The palette index prediction data may comprise runvalue data that associates run values to index values for at least aportion of the palette index map. At least one run value of the runvalue data may be associated with the escape color index.

Video data may be palette decoded, for example, by receiving in a videobitstream a palette table. The palette table may comprise a plurality ofindices that may represent palette colors of a plurality of colors.Palette index map parameters may be received in the video bitstream. Thepalette index map parameters may represent a series of indices. One ormore indices, e.g., each index, of the series of indices may map one ormore pixels of a coding unit of the video data to either a palette colorof the palette table or to an escape color mode. Based on the paletteindex map parameters, the pixels of the coding unit that may be mappedby the palette index map to the escape color mode may be determined.After receiving the set of index map parameters for the coding unit, adecoder may receive escape color parameters that may indicate the escapecolor values for each of the pixels of the coding unit mapped to theescape color mode. The colors for the pixels of the coding unit may bereconstructed based on the received palette index map parameters and thereceived escape color parameters.

Video data may be palette coded by producing a palette table that maycomprise a plurality of indices that may represent palette colors of aplurality of colors. A palette index map may be created for a codingunit of the video data. The palette index map may comprise a series ofindices. One or more indices, e.g., each index, of the series may betaken either from the plurality of indices in the palette table or froman index indicative of an escape color mode. The series of indices mayselectively map pixels of the coding unit to the palette colors or tothe escape color mode. The palette table and palette index mapparameters may be transmitted in a video bitstream. The palette indexmap parameters may represent the series of indices of the palette indexmap for the coding unit. After the palette index map parameters aretransmitted, additional parameters may be transmitted in the videobitstream. These additional parameters may indicate the escape colorvalues for the pixels of the coding unit mapped to the escape colormode.

BRIEF DESCRIPTION OF THE DRAWINGS

A more detailed understanding may be had from the following description,given by way of example in conjunction with the accompanying drawingswherein:

FIG. 1 is a block diagram of a screen content sharing system.

FIG. 2 is a block diagram of a video decoder.

FIG. 3 is a block diagram of a video encoder.

FIG. 4 illustrates eight prediction unit modes in HEVC.

FIG. 5A illustrates an exemplary piece of screen content in the form ofa word.

FIG. 5B shows a palette index map of the piece of screen content of FIG.5A.

FIG. 6 illustrates a number of example scan orders.

FIG. 7A illustrates an example of BWT encoding.

FIG. 7B illustrates an example of BWT decoding.

FIG. 8 illustrates an example of copy-left mode.

FIG. 9 illustrates examples of transition mode prediction.

FIG. 10 illustrates an example of a Rice parameter lookup table for arun mode.

FIG. 11 illustrates an example of escape color index reordering.

FIG. 12 illustrates an example of escape color prediction.

FIG. 13 illustrates an example of escape color encoding.

FIG. 14A is a system diagram of an example communications system inwhich one or more disclosed embodiments may be implemented.

FIG. 14B is a system diagram of an example wireless transmit/receiveunit (WTRU) that may be used within the communications systemillustrated in FIG. 14A.

FIG. 14C is a system diagram of an example radio access network and anexample core network that may be used within the communications systemillustrated in FIG. 14A.

FIG. 14D is a system diagram of another example radio access network andanother example core network that may be used within the communicationssystem illustrated in FIG. 14A.

FIG. 14E is a system diagram of another example radio access network andanother example core network that may be used within the communicationssystem illustrated in FIG. 14A.

DETAILED DESCRIPTION

A detailed description of illustrative embodiments will now be describedwith reference to the various Figures. Although this descriptionprovides a detailed example of possible implementations, it should benoted that the details are intended to be exemplary and in no way limitthe scope of the application.

FIG. 1 is a block diagram illustrating an example screen content sharingsystem. The screen content sharing system may include a receiver 10, adecoder 12, and a display (e.g., a renderer) 14. The receiver 10 mayreceive video signals and may demodulate them for forwarding to thedecoder 12, which may decode the video stream and may generate aplurality of separate pictures stored in multiple picture buffers 16that may be output to the display 14.

FIG. 2 is a block diagram illustrating an example block-based singlelayer decoder that may be used as decoder 12 in FIG. 1 . It may receivea video bitstream 201 produced by an encoder and may reconstruct thevideo signal to be displayed. At the video decoder, the bitstream 201may be parsed by an entropy decoder 203. The residual coefficients maybe inverse quantized in a de-quantizer logical block 205 and may beinverse transformed in an inverse transform logical block 207 to obtaina reconstructed residual signal 209. The coding mode and predictioninformation may be used to obtain a prediction signal 215 using spatialprediction (e.g., a spatial prediction logical block 211) and/ortemporal prediction (e.g., a temporal prediction logical block 213). Theprediction signal 215 and the reconstructed residual signal 209 may beadded together to obtain a reconstructed video signal 217. Thereconstructed video signal may additionally go through loop filtering(e.g., a loop filter logical block 219) before being stored in areference picture store 221 to be displayed on a monitor 223 and/or usedto decode a future video signal.

FIG. 3 is a block diagram illustrating an example block-based singlelayer video encoder that may be used to generate the encoded video datareceived at the screen content sharing system of FIG. 1 . As shown inFIG. 3 , to achieve efficient compression, a single layer encoder mayemploy, for example, spatial prediction (e.g., intra prediction) at ablock 301 and/or temporal prediction (e.g., inter prediction and/ormotion compensated prediction) at a block 303 to predict an input videosignal 300. The encoder may also have mode decision logic 305 that maychoose a suitable form (e.g., the most suitable form) of prediction, forexample, based on certain criteria such as a combination of rate anddistortion considerations. The encoder may then transforms at a block307 and/or quantize at a block 309 a prediction residual 310 (e.g., thedifference signal between the input signal 300 and a prediction signal311). A quantized residual 313, together with the mode information(e.g., intra or inter prediction) and the prediction information 311(e.g., motion vectors, reference picture indices, intra predictionmodes, etc.) may be further compressed at an entropy coder 315 andpacked into an output video bitstream 317. As shown in FIG. 3 , theencoder may generate a reconstructed video signal 325 by applyinginverse quantization at a block 319 and/or inverse transformation at ablock 321 to the quantized residual to obtain a reconstructed residual323, and adding it back to the prediction signal 311. The reconstructedvideo signal 325 may additionally go through a loop filter 327 (forexample, deblocking filter, Sample Adaptive Offsets, and/or AdaptiveLoop Filters), and may be stored in a reference picture store 329 to beused to predict future video signals.

MPEG has been working on video coding standards to save transmissionbandwidth and storage. High Efficiency Video Coding (HEVC) is anemerging video compression standard jointly developed by the ITU-T VideoCoding Experts Group (VCEG) and ISO/IEC Moving Picture Experts Group(MPEG). HEVC may be a block-based hybrid video coding standard in thatits encoder and decoder may operate according to FIGS. 2 and 3 . HEVCmay allow the use of larger video blocks compared to other standards,and may use quadtree partition to signal block coding information. Thepicture or slice may be partitioned into coding tree blocks (CTBs) withthe same size (e.g., 64×64). A CTB may be partitioned into coding units(CUs) with quadtree, and a CU may be partitioned further into predictionunits (PU) using some patterns and transform units (TU), also usingquadtree. For each inter coded CU, its PU may have one of eightpartition modes, as shown in FIG. 4 . Temporal prediction, e.g., motioncompensation, may be applied to reconstruct the inter coded PUs.Depending on the precision of the motion vectors, which may be up toquarter pixel in HEVC, linear filters may be applied to obtain pixelvalues at fractional positions. In HEVC, the interpolation filters mayhave, for example, seven or eight taps for luma and four taps forchroma. The deblocking filter in HEVC may be content-based. Differentdeblocking filter operations may be applied at the TU and PU boundaries,depending on a number of factors, such as coding mode difference, motiondifference, reference picture difference, pixel value difference, etc.For entropy coding, HEVC may adopt context-based adaptive arithmeticbinary coding (CABAC) for most block level syntax elements. CABAC codingmay use context-based coded regular bins and/or bypass coded binswithout context.

Screen content material, such as text and graphics, may show differentcharacteristics than natural video content. Coding tools may improve thecoding efficiency of screen content coding, e.g., based on palettecoding and/or intra block copy.

As shown in FIG. 5A, screen content blocks may include a limited numberof colors, and the color value of a pixel may be repeated from anadjacent (e.g., above or left or right) pixel. A palette table may beused as a dictionary to record the significant pixel values and thecorresponding palette index map may be used to represent the colorvalues of the corresponding pixels, as shown in FIG. 5B. To reduce thespatial redundancy, “run” values may be used to indicate the length ofconsecutive pixels that have the same palette index value, e.g., colorindex. Using a palette-based coding method may improve the compressionperformance for coding screen content.

A Burrows-Wheeler Transform (BWT) may be used in lossless datacompression. BWT may rearrange an input character string into multipleruns of elements with the same character. To output the rearrangedstring, a table may be created to store the possible rotations of theinput string. The rotated strings may be sorted. A column (e.g., thefinal column) of the sorted data may be extracted as the output string.Beside the output string, the end of the block position may betransmitted to facilitate reconstruction at the decoder side. An exampleof BWT is shown in FIG. 7A. The source is “BANANA”, and the output ofBWT is “NNBAAA”.

Decoding may involve appending the transformed string to a decodingtable. The decoding table may be sorted. Appending the transformedstring to the decoding table and sorting the decoding table may beperformed for k rounds, where k may be the string length. For the lastround, the string with the end of block position at the end may be theoriginal string. For example, in FIG. 7B, the transformed string“NNBAAA” may be appended to the decoding table. After sorting, the firstcolumn of the decoding table may become “AAABNN.” At the second round,the string “NNBAAA” may be appended to the decoding table again, and thetable may be sorted again. After six rounds (e.g., the length of thestring), the fourth row of the decoding table which with the end ofblock position “A” may be the original string. In entropy coding, threecharacters may be signaled, e.g., “N,” “B,” and “A,” with threecorresponding run values, e.g., 1, 0, and 2, respectively. Therearranged string may be more compression-friendly than the originalinput string. The BWT coding method may be suitable to be applied inimproving the efficiency of palette index map coding.

The performance of components of palette coding, including BWT-basedpalette index map reordering, escape color signaling, palette indexprediction, and palette index map coding may be provided. The codingtechniques may be applied to HEVC coding or other video codecs.

Some video coding standards may not fully optimize the compressionperformance of screen content coding. For example, some general purposeencoders may be optimized for natural video sequences. Screen contentmay include many more sharp edges with discrete color distribution anddiscontinuous tone than natural video sequences. After applying somemode decision and transform-based coding processes, some residual valuesmay be located in high frequency areas such that a residual scan methodmay be inefficient for the entropy coding process that may follow. Apalette-based coding method may improve the coding performance of screencontent blocks by forming a palette by selecting the commonly appearingcolors in the block that is encoded from a color histogram andconverting a CU pixel to a palette index by searching for the mostsimilar element in the palette table. A run value may be used toindicate a number of consecutive pixel positions that share the samepalette index and may reduce the overhead of representing paletteindices. A prediction mode, e.g., a run mode or a copy mode, may be usedto indicate whether the palette index of the current pixel is predictedfrom the palette index of the pixel to the left/right of the currentpixel position in horizontal raster scan order or predicted from thepixel positioned above the current pixel position.

A CU pixel may be clustered into major colors and escape colors to formthe palette table. A line mode may be used to encode the palette index.Palette-based coding methods may show significant coding gain. Thepalette index map may be scanned in the horizontal raster scan order.The discontinuousness issue may occur when scanning to the next line;this may cause more coding bits to be used in signaling the palettecoding mode. Further, geometric correlation between adjacent positionsin the palette index map may be exploited using run and copy modeprediction.

Palette index map reordering may use BWT coding. The reordered index mapmay be compression-friendly and may improve the efficiency of paletteindex map coding.

The escape color may be assigned to a fixed palette map index, such thatthe identification of escape color may be realized through palette indexsignaling.

The index value of an escape color may be set to the palette table size.This may prevent signaling additional flags to indicate an escape colorposition.

A copy-left mode and/or a transition palette mode may be used to utilizethe geometric index value relations and may reduce the overhead insignaling palette index value.

Palette index map coding may effectively encode the major components ofa palette index map, e.g., mode, run value, index value, and escapecolor value.

Palette coding for screen content coding may involve BWT-based paletteindex map reordering, escape color signaling, palette index prediction,and/or palette index map coding.

The BWT may group the same elements together. The BWT may be used toincrease the correlation between adjacent positions in the palette indexmap. The BWT may be applied before encoding the palette index map.Before applying the BWT, for the palette index scan order, a positionmay be predicted in the vertical or horizontal raster scan order, asshown at examples (a) and (b), respectively, in FIG. 6 . The vertical orhorizontal raster scan order may exhibit the discontinuousness issue;e.g., the index value of the first position of a row may have a highprobability of being different from the last position of the previousrow. This may cause the BWT to be inefficient and may increase thenumber of symbols used for encoding. To mitigate the discontinuousnessissue, a transverse scan order (e.g., as shown at examples (c) and (d)in FIG. 6 ) or a zig-zag scan order (e.g., as shown at examples (e) and(f) in FIG. 6 ) may be used. This scanning method may keep thesimilarity of adjacent positions along the scan order path.

After positions are scanned as a one-dimensional index sequence, thesequence may be fed into the BWT process and the end position as BWTside information (e.g., overhead) may be coded for decoder sidereconstruction. The side information of BWT may be an overhead forBWT-based coding, which may cause no coding gain or loss for someblocks. A one-bit flag may be used to indicate whether BWT is performedor not. The flag may be signaled at a sequence level, at a picture orslice level, or CU level, for example, depending on the application. Thecomplexity of BWT may be related to sorting, and storing theencoding/decoding table may use considerable memory space. The datastructure for BWT input may be a ring buffer. For an m×m block, it maycreate mxm pointers to point to the block positions, and sorting may beperformed between these pointers. This may reduce the memory space usedby the encoding/decoding table.

To identify pixels that may not have a corresponding entry in thepalette table, pixels may be classified as escape color pixels. Thecolor classification may be represented as in Equations (1) and (2), inwhich error(C, PLT) may be the minimum error between the color C and themost similar color PLT in the palette table. If error(C, PLT) is lessthan the threshold ERROR_LIMIT, the color C may be a major color. Iferror(C, PLT) is not less than the threshold ERROR_LIMIT, the color Cmay be an escape color. The error function may be measured by the meansquare error between the color C and the i^(th) palette entry Pi.

$\begin{matrix}{{{Type}(C)} = \left\{ \begin{matrix}{{Major}_{Color},} & {{{error}\left( {C,{PLT}} \right)} < {ERROR\_ LIMIT}} \\{{Escap}_{Color},} & {{{error}\left( {C,{PLT}} \right)} \geq {ERROR\_ LIMIT}}\end{matrix} \right.} & (1) \\{{{error}\left( {C,{PLT}} \right)} = {\min\limits_{i}\left( {{dist}\left( {C,P_{i}} \right)} \right)}} & (2)\end{matrix}$

Escape colors may be signaled using palette indices that are not used tosignal non-escape colors, e.g., major colors. Signaling escape colors inthis way may avoid the signaling overhead associated with using adedicated flag bit or flag bits to signal an escape color. For example,to identify the location of these escape color pixels without the use ofadditional flag bits to signal an escape color, the palette index of theescape color may be set to the maximum palette index value plus 1. Forexample, if the maximum palette index value is 30, the palette index ofthe escape color may be set to 31.

Palette index prediction may utilize the geometrical relations betweenpixels. Palette index prediction may employ a copy-left mode and/or atransition mode. A pixel may be copied from a previously reconstructedpixel located above it. In a run mode, a pixel may be copied from itsimmediate left neighbor.

In run and copy modes coding, two consecutive copy modes may be mergedas a single copy mode. A second copy mode may be used to signal acopy-left mode if the previous mode is a copy mode. For the copy-leftmode, the starting position may be compared to its previous position,and may be used when the previous coding mode is the copy mode. Thecopy-left mode may signal the run value without signaling a paletteindex value. FIG. 8 illustrates an example of copy-left mode. If the runand copy modes are used and the previous mode of a pixel 802 is a copymode (indicated by dark pixels 804 in FIG. 8 ), the pixel 802 may becoded as run mode. The palette index value may be signaled as 1, and therun value may be signaled. Signaling the palette index value as 1 may beomitted because the signaled index value may be the same as the previousmode. The copy-left mode may be used to reduce overhead; when thecopy-left mode is enabled, the pixel 802 may be compared to its previousposition, and the run value (e.g., only the run value) may be signaled.

When signaling the copy-left mode, the mode value of the copy-left modemay be coded similarly as the copy mode. At the decoder side, when thecurrent mode and the previous mode are both signaled as the copy mode,the current mode may be interpreted as the copy-left mode. Accordingly,the copy-left mode may be signaled without using an additional modevalue. If the previous mode is the copy-left mode and the current modeis the copy mode, the current mode may still be the copy mode.

A transition mode may allow palette indices for current pixels to becopied from a previously occurring pattern of palette indices. Thelocation of the previously occurring pattern may be indicated relativeto a recent (e.g., the most recent) previous appearance of an indexvalue of a neighbor to the starting position.

The transition mode may involve selecting a neighbor of the startingposition and determining its index value. The most recent previousappearance of the index value may be located and may be selected as theanchor position. A neighbor position of the anchor position may bechosen as the starting position for copying index values. For example,in example (a) of FIG. 9 , the left position of the starting position(indicated in dashed line) may be chosen, and its last appearanceposition may be selected as the anchor position. The right position ofthe anchor position (indicated in bold) may be selected as the startingposition to copy index values. In the examples shown in FIG. 9 , thepreviously occurring index pattern, which may be the source for thecopy, is indicated by reference numeral 902, and the copied indices,e.g., the indices encoded using the transition mode, are indicated byreference numeral 904.

For the transition mode, the neighboring position relative to thestarting position that may be used to determine the anchor position maybe signaled. The neighboring position relative to the anchor positionthat may be used as the start of the pattern to be copied may besignaled. The transition mode may be enabled when the CU has a largepalette table size to mitigate the overhead of using the transitionmode. For example, when the palette table size is small, the run andcopy modes may be the frequently used palette modes. If the transitionmode is also enabled, the total palette modes may be increased to three,and more bits may be used to signal the palette modes even if thetransition mode is not chosen. When the palette table size is large, thetransition mode may be used to search an index pattern to cover theprediction shortage of run or copy modes and to compensate the overheadby using the transition mode. The transition mode may be used withoutBWT coding.

Coding tools may be used to efficiently compress the palette index map.These coding tools may include index value coding, run value coding, andpalette escape color prediction.

In palette coding, an index value may be transmitted when signaling arun mode. In an embodiment, an index value may be coded as a fixedlength code word. For example, if the palette table size is 31, fivebits may be used to encode a level value. Even if the index value is 1,five bits may be used to encode that value. In an embodiment, variablelength coding (e.g., Exponential-Golomb coding) may be used to encodethe index value. Coding tools may be used to efficiently encode theindex value, such as index value reduction and/or escape color indexreordering.

An encoder, e.g., the encoder of FIG. 3 , may palette video data byproducing a palette table comprising a plurality of color indicescorresponding to respective colors of a plurality of colors. The encodermay create a palette index map. The palette index map may map one ormore pixels of the video data to one or more color indices in thepalette table. The encoder may generate palette index prediction databased on the palette index map. The palette index prediction data maycomprise data that may indicate index values for at least a portion ofthe palette index map. Generating the palette index prediction data mayinclude determining whether to adjust an index value of the paletteindex map based on a last index value.

To reduce the magnitude of the index value (e.g., color index), theindex value may be modified according to a previous coding mode. Forexample, the index value may be decreased by one according to the lastindex value of the previous coding mode, which may be denoted as pint.If the current index value is larger than pim_(i), the coded index valuemay be the current index value minus 1. Otherwise, the current indexvalue may be unchanged. The number of bits used to code an index valuemay be effectively reduced. For example, if pim_(i) is 6 and the currentindex value is 7, the coded index value is 7−1=6. When using theExponential-Golomb coding with order 0, 7 is coded as 0001000. To encode6, the code word is 00111; accordingly, the code word length may bereduced from seven bits to five bits. At the decoder side, the decodermay compare to pim_(i) to reconstruct the current index value. Ifpim_(i) is less than or equal to the current index value, the currentindex value may be increased by 1.

To signal the position of escape color pixels, the index value of escapecolor pixels may be set to the maximum palette index value. The firstindex value may be set to zero. The appearance probability of an escapecolor may be higher than that of most major colors. To reduce theoverhead of signaling the index value of escape color pixels, the indexvalue of escape color pixels may be swapped with a front index value. Asillustrated in FIG. 11 , the escape color index value may be n beforereordering. After reordering, the escape color index may be changed tom, and the original index values from m to (n−1) may be shifted to m+1to n. The selection of a value of m may be based on the original, forexample, such that indices from 0 to (m−1) may be more frequently usedthan the escape color index, and the original indices from m to (n−1)may be less frequently used than the escape color index. If such a valueof m exists, the escape color index may be changed to m. For example, ifthe palette table size is 31, and the index value of the escape color isset to 31, after the index reordering, the index value of the escapecolor may be changed to 2, and the index values from 2 to 30 may beshifted to 3 to 31. By using the Exponential-Golomb coding with order 0,the index value 31 may be coded as 000011111. If the index value of theescape color is swapped with 2, the code word used to present the escapecolor may be 011; accordingly, the escape color index reordering mayreduce the signaling overhead of escape color pixels.

In one-dimensional palette coding, a run value may be used to indicatethe length of the consecutive positions segment. A variable lengthcoding method (e.g., Golomb-Rice coding or Exponential-Golomb coding)may be used to effectively encode the run value. The setting of the Riceparameter may be a consideration in Golomb-Rice coding. For example,with the Rice parameter set at 0, the value 6 may be encoded as 1111110.With the Rice parameter set at 1, the code word may be 11100. Theparameter setting may affect the coding efficiency. A value may beencoded using the best Rice parameter, but signaling these parametersettings may use overhead and may decrease coding performance. A Riceparameter may be estimated for a run mode or a non-run mode.

If the current palette coding mode is run mode, a Rice parameter lookuptable may be used to predict the Rice parameter value. Rice parametersfor the same index value may be highly correlated. The Rice parameterused for a current run value may be derived from previous Riceparameters. A Rice parameter lookup table may be used to record thepreviously used Rice parameters for a palette index. For example, asshown in FIG. 10 , two previous Rice parameters rp(x,0) and rp(x,1) maybe recorded for an index. These may represent the last and second-lastRice parameters for the index x. Equation (3) may be used to derive theRice parameter:

$\begin{matrix}{{crp}_{x} = \left\{ {\begin{matrix}{{\min\left( {{RP\_ LIMIT},{\left( {{{rp}\left( {x,0} \right)} + {{rp}\left( {x,1} \right)}} \right) ⪢ 1}} \right)},{{when}\mspace{14mu}{{rp}\left( {x,0} \right)}\mspace{14mu}{is}\mspace{14mu}{even}}} \\{{\min\left( {{RP\_ LIMIT},{\left( {{{rp}\left( {x,0} \right)} + {{rp}\left( {x,1} \right)} + 1} \right) ⪢ 1}} \right)},{{when}\mspace{14mu}{{rp}\left( {x,0} \right)}\mspace{14mu}{is}\mspace{14mu}{odd}}}\end{matrix},} \right.} & (3)\end{matrix}$

where crp_(x) may be the estimated Rice parameter and RP_LIMIT may bethe upper bound of the Rice parameter. After obtaining the estimatedRice parameter, the Rice parameter lookup table may be updated.Equations (4) and (5) may be used to update the table:rp(x,1)=rp(x,0),  (4)rp(x,0)=crp _(x),  (5)

In a non-run mode, index copying may be performed, and various indexvalues may be copied. An overlooking strategy may be used to obtain theRice parameter for the non-run mode. Before encoding the index map,candidate Rice parameters may be tested. The candidate with the leastoverhead may be selected as the Rice parameter for the non-run mode. Theestimation process may be performed as follows, for example:

Int function getRiceParameterForNonRunMode set BestParameter to 0; setoverhead to 0; set minimal_overhead to MAX_INT; For (i=0;i<candidate_Rice_parameters; i++) { set overhead to 0; For (j=0;j<index_map_size; j++) { If palette_mode(j) is non-run mode overhead +=calculate_overhead(run (j), i); } If overhead is smaller thanminimal_overhead set minimal_overhead to overhead; set BestParameter toi; } return BestParameter;

For escape color coding, the pixel value of a color component may becoded or predicted from its neighboring pixels. The escape color valuemay be predicted from the palette table entry with the minimal error.For example, as shown in FIG. 12 , the palette table entry i with theminimal error to the escape color pixel may be selected. In entropycoding, the index value of the predicted table entry (e.g., the palettetable entry determined by the encoder to have the minimal error comparedto the escape color), the absolute difference value, and the sign bitmay be signaled to the decoder side. At the decoder, these values may beused to reconstruct the escape color pixel.

The previously encoded escape colors may be used for the prediction ofescape colors. The already coded escape colors may be stored in a listfor a current coding unit. The most recent escape color may be placed atthe beginning of the list, e.g., the most recent escape color may be thefirst entry of the list. The list may be a coded escape color stack. Fora current escape color to be coded, a predictor (e.g., the bestpredictor) may be selected, for example, from the coded escape colorstack or the palette table using rate distortion optimization criteria.A prediction type value (e.g., flag) may indicate whether the predictoris from the coded escape color stack or the palette table. An index maybe coded to indicate which entry, e.g., an entry from the coded escapecolor stack or an entry from the palette table, is used as a predictor.An update process may be performed after the current escape color iscoded. If the current coded escape color is predictive coded and theresidual is not zero, or if the current escape color is not predictivecoded, it may be regarded as a new escape color and may be added at thetop of the stack. If the stack is full, then the last entry in the stackmay be removed. The entry at the top of the stack may be associated withthe smallest index value (e.g., zero), and the index values for otherentries may be assigned in an increasing order. The coded escape colormay be initialized in different ways before current coding unit coding.For example, the stack may be filled with those colors in the palettetable predictor that may not be used to predict any colors in thepalette table of the current coding unit.

Escape color index adjustment, repeated escape color coding, and/or skipescape color coding decision may be used to further reduce the overheadof signaling escape color pixels. FIG. 13 illustrates an example ofpalette escape color prediction.

The escape color value may be the same as a palette table entry afterquantization. The palette index of these escape colors may be adjustedto the index of the corresponding palette table entry. Adjustment may beperformed after escape color quantization. For adjustment, quantizedescape color pixels may be compared to palette table entries, and theescape color index may be reset to the index of the correspondingpalette table entry when they are the same.

A one-bit flag may be signaled before escape color prediction toindicate whether the current escape color pixel is the same as theprevious escape color pixel. Escape color prediction may be omitted oncethe current and previous escape color pixels are the same.

Before coding escape colors in a CU, a rate-distortion decision functionmay be used to determine whether to signal difference values. Thedecision function may be used to compare the rate-distortion costbetween signaling and not signaling difference values. If the decisionis to signal escape colors, the predicted table entry index, differencevalue, and sign bit may be signaled, for example, at 1302, 1304, and1306 of FIG. 13 . Otherwise, an escape color index may be adjusted tothe index of a palette table entry, for example, with the bestrate-distortion performance.

The principles disclosed herein may be disclosed in the context ofExponential-Golomb coding or Golomb-Rice coding as examples of variablelength coding, but may be applicable to other variable length codingalgorithms.

Syntax elements may be used to signal CUs that are coded with palettecoding mode, e.g., based on the syntax of HEVC. The palette codingmethods disclosed herein may be signaled in the bitstream using syntaxelements, for example, as illustrated in Tables 1 and 2. As shown inTable 2, escape colors may be coded separately, e.g., in a separateloop, from major colors, e.g., colors represented in the palette table.

TABLE 1 Descriptor coding_unit( x0, y0, log2CbSize ) { if(transquant_bypass_enabled_flag ) cu_transquant_bypass_flag ae(v) if(slice_type != I ) cu_skip_flag[ x0 ][ y0 ] ae(v) nCbS = ( 1 <<log2CbSize) if( cu_skip_flag[ x0 ][ y0 ] ) prediction_unit( x0, y0,nCbS, nCbS ) else { if( intra_block_copy_enabled_flag ) intra_bc_flag[x0 ][ y0 ] ae(v) if( slice_type != I && !intra_bc_flag[ x0 ][ y0 ])pred_mode_flag ae(v)  if( CuPredMode[ x0 ][ y0 ] == MODE_INTRA )palette_mode_flag[ x0 ][ y0 ] ae(v) if( (CuPredMode[ x0 ][ y0 ] !=MODE_INTRA || intra_bc_flag[ x0 ][ y0 ] || log2CbSize = =MinCbLog2SizeY) && !palette_mode_flag[ x0 ][ y0 ] ) part_mode ae(v) if(CuPredMode[ x0 ][ y0 ] = = MODE_INTRA ) { if( PartMode = = PART_2Nx2N &&pcm_enabled_flag && !intra_bc_flag[ x0 ][ y0 ] && !palette_mode_flag[ x0][ y0 ] && log2CbSize >= Log2MinIpcmCbSizeY && log2CbSize <=Log2MaxIpcmCbSizeY ) pcm_flag[ x0 ][ y0 ] ae(v) if( pcm_flag[ x0 ][ y0 ]) { while( !byte_aligned( ) ) pcm_alignment_zero_bit f(1) pcm_sample(x0, y0, log2CbSize ) } else if( intra_bc_flag[ x0 ][ y0 ] ) {mvd_coding( x0, y0, 2) if( PartMode = = PART_2NxN ) mvd_coding( x0, y0 +( nCbS / 2 ), 2) else if( PartMode = = PART Nx2N ) mvd_coding( x0 + (nCbS / 2 ), y0, 2) else if( PartMode = = PART_NxN ) { mvd_coding( x0 + (nCbS / 2 ), y0, 2) mvd_coding( x0, y0 + ( nCbS / 2 ), 2) mvd_coding(x0 + ( nCbS / 2 ), y0 + (nCbS / 2 ), 2) } } else if (palette_mode_flag[x0 ][ y0 ] ) palette_coding( x0, y0, nCbS, nCbS ) else { pbOffset =(PartMode = = PART_NxN ) ? ( nCbS / 2 ) : nCbS for( j = 0; j < nCbS; j =j + pbOffset ) for( i = 0; i < nCbS; i = i + pbOffset )prev_intra_luma_pred_flag[ x0 + i ][ y0 + j ] ae(v) for( j = 0; j <nCbS; j = j + pbOffset ) for( i = 0; i < nCbS; i = i + pbOffset ) if(prev_intra_luma_pred_flag[ x0 + i ][ y0 + j ] ) mpm_idx[ x0 + i ][ y0 +j ] ae(v) else rem_intra_luma_pred_mode[ x0 + i ][ y0 + j ] ae(v) if(ChromaArrayType = = 3 ) for( j = 0; j < nCbS; j = j + pbOffset ) for( i= 0; i < nCbS; i = i + pbOffset) intra_chroma_pred_mode[ x0 + i ][ y0 +j ] ae(v) else if( ChromaArrayType ! = 0 ) intra_chroma_pred_mode[ x0 ][y0 ] ae(v) } } else { if( PartMode = = PART_2Nx2N) prediction_unit( x0,y0, nCbS, nCbS ) else if( PartMode = = PART_2NxN ) { prediction_unit(x0, y0, nCbS, nCbS / 2 ) prediction_unit( x0, y0 + ( nCbS / 2 ), nCbS,nCbS / 2 ) } else if( PartMode = = PART_Nx2N ) { prediction_unit( x0,y0, nCbS / 2, nCbS ) prediction_unit( x0 + ( nCbS / 2 ), y0, nCbS / 2,nCbS ) } else if( PartMode = = PART_2NxnU) { prediction_unit( x0, y0,nCbS, nCbS / 4 ) prediction_unit( x0, y0 + (nCbS / 4 ), nCbS, nCbS * 3 /4 ) } else if( PartMode = = PART_2NxnD ) { prediction_unit( x0, y0,nCbS, nCbS * 3 / 4 ) prediction_unit( x0, y0 + (nCbS * 3 / 4 ), nCbS,nCbS / 4 ) } else if( PartMode = = PART_nLx2N ) { prediction_unit( x0,y0, nCbS / 4, nCbS ) prediction_unit( x0 + ( nCbS / 4 ), y0, nCbS *3/4,nCbS ) } else if( PartMode = = PART_nRx2N ) { prediction_unit( x0, y0,nCbS * 3 / 4, nCbS ) prediction_unit( x0 + ( nCbS * 3 / 4 ), y0, nCbS /4, nCbS ) } else { /* PART_NxN */

TABLE 2 Descriptor palette_coding( x0, y0, nCbWidth, nCbHeight ) {palette_size_minus1[ x0][ y0 ] ae(v) for( n = 0; n < palette_size_minus1[ x0][ y0 ]; n ++ ) { for( cIdx = 0; cIdx < 3; cIdx++) palette[ x0 ][ y0][n][ cIdx ] ae(v) } palette_index_scan_order[ x0 ][ y0 ] ae(v)palette_bwt_flag[ x0 ][ y0 ] ae(v) if( palette_bwt_flag[ x0 ][ y0 ] )palette_bwt_eob_pos[ x0 ][ y0 ] ae(v) scanPos = 0non_run_mode_rice_parameter ae(v) while ( scanPos < nCbWidth * nCbHeight) { palette_mode[ x0 ][ y0 ][ scanPos ] ae(v) if( palette_mode ==RUN_MODE) mapped_palette_index[ x0 ][ y0 ][ scanPos ] ae(v) else if(palette_mode==transition_mode) { transition_mode_neighbor_positionae(v) transition_mode_copy_direction ae(v) } run[ x0 ][ y0 ][ scanPos ]ae(v) scanPos += run scanPos ++ } scanPos = 0 while ( scanPos <nCbWidth * nCbHeight ) { if ( palette_index[ x0 ][ y0 ][ scanPos ] ==palette_size_minus1[ x0 ][ y0 ] + 1 ) { repeated_escape_color_flag[ x0][ y0 ][ scanPos ] ae(v) if( !escape_color_pred_flag[ x0 ][ y0 ][scanPos ] ) { predicted_palette_table_index[ x0 ][ y0 ][ scanPos ] ae(v)for( cIdx = 0; cIdx < 3; cIdx ++ ) {escape_color_residue_absolute_level[ x0 ][ y0 ][ scanPos ][ cIdx ] ae(v)if( escape_color_resi_abs_level[ x0 ][ y0 ][ scanPos ][ cIdx ] )escape_color_residue_sign[ x0 ][ y0 ][ scanPos ][ cIdx ] ae(v) } } }scanPos ++ } }

A syntax element palette_index_scan_order may represent a predefinedscan order. If palette_index_scan_order is 0, the raster scan order maybe used in the palette index prediction. If palette_index_scan_order is1, a transverse scan order may be used. If palette_index_scan_order is2, a zig-zag scan order may be used.

A syntax element palette_bwt_flag may indicate whether a BWT codingmethod is enabled. If palette_bwt_flag is 1, the BWT coding method maybe enabled. If palette_bwt_flag is 0, the BWT coding method may bedisabled.

A syntax element palette_bwt_eob_position may represent an end of blockposition for BWT decoding.

A syntax element non_run_moderice_parameter may represent a Riceparameter for decoding the run value for non-run mode.

A syntax element palette_mode may represent a palette coding mode (e.g.,run mode, copy mode, or transition mode).

A syntax element transition_mode_neighbor_position may represent theneighbor position relative to the start position used to locate theanchor position in transition mode. If transition_mode_neighbor_positionis 1, the upper neighbor position may be used. Iftransition_mode_neighbor_position is 0, the left neighbor position maybe used.

A syntax element transition_mode_copy_direction may represent theneighbor position relative to the anchor position from which to startcopying index values in the transition mode. Iftransition_mode_copy_direction is 1, the lower neighbor position may beindicated. If transition_mode_copy_direction is 0, the right neighborposition may be indicated.

A syntax element run may represent a number of consecutive locationswith the same palette index (e.g., “run_mode_flag=1”) or the number ofconsecutive locations with the same palette index as the position in theabove row (e.g., as used in the copy mode). The run value may be decodedby using the Rice parameter lookup table in run mode. For the non-runmode, the run value may be decoded by the non_run_mode_rice_parameter.

A syntax element repeated_escape_color_flag may indicate whether anescape color value is repeated. If repeated_escape_color_flag is 1, thecurrent escape color value may be set to the previous escape colorvalue. If repeated_escape_color_flag is 0, the current escape colorvalue may be different from the previous escape color value.

A syntax element predicted_palette_table_index may represent the indexvalue of the predicted palette table entry for the current escape color.

A syntax element escape_color_residue_absolute_value may represent theabsolute difference between the current escape color and the predictedpalette table entry.

A syntax element escape_color_residue_sign may represent the sign valueof the difference between the current escape color and the predictedpalette table entry.

The palette coding methods disclosed herein may be signaled in thebitstream using syntax elements, for example, as illustrated in Table 3.Escape color values may be coded separately from a coding loop ofpalette indices.

For example, video data may be encoded by producing a palette tablecomprising indices that may represent palette colors. A palette indexmap may be created for a coding unit of the video data. The paletteindex map may comprise indices, e.g., a series of indices. The indicesmay be taken, for example, from the indices in the palette table or froman index that may indicate an escape color mode. The indices mayselectively map pixels of the coding unit to the palette colors or tothe escape color mode. The palette table and palette index mapparameters that may represent the series of indices of the palette indexmap for the coding unit may be transmitted in a video bitstream. Afterthe palette index map parameters are transmitted, additional parametersmay be transmitted in the video bitstream. These additional parametersmay indicate the escape color values for the pixels of the coding unitmapped to the escape color mode.

For example, video data may be decoded by receiving in a bitstream apalette table comprising a plurality of indices that may representpalette colors. Palette index map parameters may also be received in avideo bitstream. The palette index map parameters may represent indices,e.g., a series of indices. The indices may map one or more pixels of acoding unit of the video data to a palette color of the palette table orto an escape color mode. The palette index map parameters may be used todetermine the pixels of the coding unit that may be mapped by thepalette index map to the escape color mode. Escape color parameters maybe received. The escape color parameters may indicate the escape colorvalues for the pixels of the coding unit mapped to the escape colormode. The colors for the pixels of the coding unit may be reconstructedbased on the received palette index map parameters and the receivedescape color parameters.

TABLE 3 Descriptor coding_unit( x0, y0, log2CbSize) { if(transquant_bypass_enabled_flag ) cu_transquant_bypass_flag ae(v) nCbS =(1 << log2CbSize) if (palette_mode_flag) { palette_index_scan_orderae(v) palette_bwt_flag ae(v) if (palette_bwt_flag) {palette_bwt_eob_position ae(v) } palette_size_minus1[x0][y0] ae(v) for(cIdx = 0; cIdx < 3; cIdx ++) for( i = 0; i<=palette_size_minus1[x0][y0]; i ++ ) palette[x0][y0][ cIdx][i] ae(v)scanPos = 0 non_run_mode_rice_parameter ae(v) while (scanPos < nCbS *nCbS) { palette_mode ae(v) if (palette_mode==run_mode) { palette_indexae(v) if (palette_index==reordered_escape_color_index) palette_index =palette_size_minus1[x0][y0]+1 else if (palette_index>reordered_escape_color_index) palette_index = palette_index − 1 if(last_comp_index<=palette_index) palette_index = palette_index+1 } elseif (palette_mode==transition_mode) { transition_mode_neighbor_positionae(v) transition_mode_copy_direction ae(v) } run ae(v) runPos= 0 while(runPos <= run){ if (run_mode_flag){ paletteMap[ x0 ][ y0 ] [ scanPos ]= palette_index last_palette_mode = run_mode } else if (copy_mode_flag&& last_palette_mode != copy_mode){ /* copy mode */ paletteMap[ x0 ][ y0] [ scanPos ] = paletteMap[ x0 ][ y0 ] [ scanPos − nCbS ]last_palette_mode = copy_mode } else if (copy_mode_flag &&last_palette_mode == copy_mode){ /* copy-left mode */ paletteMap[ x0 ][y0 ] [ scanPos ] = paletteMap[ x0 ][ y0 ] [ scanPos −1 ]last_palette_mode = copy_left_mode } else if (transition_mode_flag){paletteMap[ x0 ][ y0 ] [ scanPos ] = transition_position(runPos,transition_mode_neighbor_position, transition_mode_copy_direction)last_palette_mode = transition_mode } runPos ++ scanPos++ } } if(!skip_escape_color_coding_flag) { while (scanPos < nCbS * nCbS) { if(paletteMap[ x0 ][ y0 ] [ scanPos ]== palette_size_minus1[x0][y0]+1) {repeated_escape_color_flag ae(v) if (!repeated_escape_color_flag) {predicted_palette_table_index ae(v) for (cIdx = 0; cIdx < 3; cIdx ++) {escape_color_residue_absolute_value ae(v)if(!absolute_escape_color_residue) { escape_color_residue_sign ae(v) } }} } runPos ++ scanPos++ } } } else { if( slice_type != I ) ..... }

A syntax element palette_index_scan_order may represent the predefinedscan order. If palette_index_scan_order is equal to 0, the raster scanorder may be used in the palette index prediction process. Ifpalette_index_scan_order is equal to 1, the traverse scan may be used.If palette_index_scan_order is equal to 2, a zig-zag scan order may beused.

A syntax element palette_bwt_flag may indicate whether the BWT codingmethod is enabled. If palette_bwt_flag is equal to 1, the BWT codingmethod may be enabled. If palette_bwt_flag is equal to 0, the BWT codingmethod may be disabled.

A syntax element palette_bwteob_position may represent the end of blockposition for BWT decoding.

A syntax element non_run_moderice_parameter may represent the riceparameter for decoding the run value for a non-run mode.

A syntax element palette_mode may represent a palette coding mode (e.g.,run mode, copy mode or transition mode).

A syntax element transition_mode_neighbor_position may represent theneighbor position relative to the start position that may be used tolocate the anchor position in a transition mode. Iftransition_mode_neighbor_position is equal to 1, the upper neighborposition may be used. If transition_mode_neighbor_position is equal to0, the left neighbor position may be used.

A syntax element transition_mode_copy_direction may represent theneighbor position relative to the anchor position from which to startcopying index values in a transition mode. Iftransition_mode_copy_direction is equal to 1, copying may start from thelower neighbor position. If transition_mode_copy_direction equal to 0,copying may start from the right neighbor position.

A syntax element run may represent the number of consecutive locationswith the same palette index (“run_mode_flag=1”) or the number ofconsecutive locations with the same palette index as the position in theabove row (as used in “copy mode”). The run value may be decoded byusing the Rice parameter lookup table in run mode. For the non-run mode,the run value may be decoded by the non_run_mode_rice_parameter.

If a syntax element repeated_escape_color_flag is equal to 1, thecurrent escape color value may be set to the previous escape colorvalue. If repeated_escape_color_flag is equal to 0, the current escapecolor value may not be the same as the previous escape color value.

A syntax element predicted_palette_table_index may represent the indexvalue of the predicted palette table entry for the current escape color.

A syntax element escape_color_residue_absolute_value may represent theabsolute difference value between the current escape color and thepredicted palette table entry.

A syntax element escape_color_residue_sign may represent the sign valueof the difference value between the current escape color and thepredicted palette table entry.

A decoder, e.g., the decoder of FIG. 2 , may palette decode video data,for example, by receiving in a video bitstream a palette table. Thepalette table may include a plurality of indices that may representpalette colors of a plurality of colors. The decoder may receive paletteindex map parameters in the video bitstream. The palette index mapparameters may represent a series of indices. One or more indices, e.g.,each index, of the series of indices may map one or more pixels of acoding unit of the video data to either a palette color of the palettetable or to an escape color mode. Based on the palette index mapparameters, the decoder may determine the pixels of the coding unit thatmay be mapped by the palette index map to the escape color mode. In aseparate loop, e.g., after receiving the set of index map parameters forthe coding unit, the decoder may receive escape color parameters thatmay indicate the escape color values for each of the pixels of thecoding unit mapped to the escape color mode, as shown, for example, inone or more of Tables 1, 2, and 3. The decoder may reconstruct thecolors for the pixels of the coding unit based on the received paletteindex map parameters and the received escape color parameters.

An encoder, e.g., the encoder of FIG. 3 , may palette code video data byproducing a palette table that may comprise a plurality of indices thatmay represent palette colors of a plurality of colors. The encoder maycreate a palette index map for a coding unit of the video data. Thepalette index map may comprise a series of indices. One or more indices,e.g., each index, of the series may be taken either from the pluralityof indices in the palette table or from an index indicative of an escapecolor mode. The indices may selectively map pixels of the coding unit tothe palette colors or to the escape color mode. The encoder may transmitpalette table and palette index map parameters in a video bitstream. Thepalette index map parameters may represent the series of indices of thepalette index map for the coding unit. After the palette index mapparameters are transmitted, the encoder may transmit one or moreadditional parameters in the video bitstream, as shown, for example, inone or more of Tables 1, 2, and 3. These additional parameters mayindicate the escape color values for the pixels of the coding unitmapped to the escape color mode.

FIG. 14A is a diagram of an example communications system 1400 in whichone or more disclosed embodiments may be implemented. The communicationssystem 1400 may be a multiple access system that provides content, suchas voice, data, video, messaging, broadcast, etc., to multiple wirelessusers. The communications system 1400 may enable multiple wireless usersto access such content through the sharing of system resources,including wireless bandwidth. For example, the communications system1400 may employ one or more channel access methods, such as codedivision multiple access (CDMA), time division multiple access (TDMA),frequency division multiple access (FDMA), orthogonal FDMA (OFDMA),single-carrier FDMA (SC-FDMA), and the like.

As shown in FIG. 14A, the communications system 1400 may includewireless transmit/receive units (WTRUs) 1402 a, 1402 b, 1402 c, and/or1402 d (which generally or collectively may be referred to as WTRU1402), a radio access network (RAN) 1403/1404/1405, a core network1406/1407/1409, a public switched telephone network (PSTN) 1408, theInternet 1410, and other networks 1412, though it will be appreciatedthat the disclosed embodiments contemplate any number of WTRUs, basestations, networks, and/or network elements. Each of the WTRUs 1402 a,1402 b, 1402 c, 1402 d may be any type of device configured to operateand/or communicate in a wireless environment. By way of example, theWTRUs 1402 a, 1402 b, 1402 c, 1402 d may be configured to transmitand/or receive wireless signals and may include user equipment (UE), amobile station, a fixed or mobile subscriber unit, a pager, a cellulartelephone, a personal digital assistant (PDA), a smartphone, a laptop, anetbook, a personal computer, a wireless sensor, consumer electronics,and the like.

The communications system 1400 may also include a base station 1414 aand a base station 1414 b. Each of the base stations 1414 a, 1414 b maybe any type of device configured to wirelessly interface with at leastone of the WTRUs 1402 a, 1402 b, 1402 c, 1402 d to facilitate access toone or more communication networks, such as the core network1406/1407/1409, the Internet 1410, and/or the networks 1412. By way ofexample, the base stations 1414 a, 1414 b may be a base transceiverstation (BTS), a Node-B, an eNode B, a Home Node B, a Home eNode B, asite controller, an access point (AP), a wireless router, and the like.While the base stations 1414 a, 1414 b are each depicted as a singleelement, it will be appreciated that the base stations 1414 a, 1414 bmay include any number of interconnected base stations and/or networkelements.

The base station 1414 a may be part of the RAN 1403/1404/1405, which mayalso include other base stations and/or network elements (not shown),such as a base station controller (BSC), a radio network controller(RNC), relay nodes, etc. The base station 1414 a and/or the base station1414 b may be configured to transmit and/or receive wireless signalswithin a particular geographic region, which may be referred to as acell (not shown). The cell may further be divided into cell sectors. Forexample, the cell associated with the base station 1414 a may be dividedinto three sectors. Thus, in one embodiment, the base station 1414 a mayinclude three transceivers, e.g., one for each sector of the cell. Inanother embodiment, the base station 1414 a may employ multiple-inputmultiple output (MIMO) technology and, therefore, may utilize multipletransceivers for each sector of the cell.

The base stations 1414 a, 1414 b may communicate with one or more of theWTRUs 1402 a, 1402 b, 1402 c, 1402 d over an air interface1415/1416/1417, which may be any suitable wireless communication link(e.g., radio frequency (RF), microwave, infrared (IR), ultraviolet (UV),visible light, etc.). The air interface 1415/1416/1417 may beestablished using any suitable radio access technology (RAT).

More specifically, as noted above, the communications system 1400 may bea multiple access system and may employ one or more channel accessschemes, such as CDMA, TDMA, FDMA, OFDMA, SC-FDMA, and the like. Forexample, the base station 1414 a in the RAN 1403/1404/1405 and the WTRUs1402 a, 1402 b, 1402 c may implement a radio technology such asUniversal Mobile Telecommunications System (UMTS) Terrestrial RadioAccess (UTRA), which may establish the air interface 1415/1416/1417using wideband CDMA (WCDMA). WCDMA may include communication protocolssuch as High-Speed Packet Access (HSPA) and/or Evolved HSPA (HSPA+).HSPA may include High-Speed Downlink Packet Access (HSDPA) and/orHigh-Speed Uplink Packet Access (HSUPA).

In another embodiment, the base station 1414 a and the WTRUs 1402 a,1402 b, 1402 c may implement a radio technology such as Evolved UMTSTerrestrial Radio Access (E-UTRA), which may establish the air interface1415/1416/1417 using Long Term Evolution (LTE) and/or LTE-Advanced(LTE-A).

In other embodiments, the base station 1414 a and the WTRUs 1402 a, 1402b, 1402 c may implement radio technologies such as IEEE 802.16 (e.g.,Worldwide Interoperability for Microwave Access (WiMAX)), CDMA2000,CDMA2000 1×, CDMA2000 EV-DO, Interim Standard 2000 (IS-2000), InterimStandard 95 (IS-95), Interim Standard 856 (IS-856), Global System forMobile communications (GSM), Enhanced Data rates for GSM Evolution(EDGE), GSM EDGE (GERAN), and the like.

The base station 1414 b in FIG. 14A may be a wireless router, Home NodeB, Home eNode B, or access point, for example, and may utilize anysuitable RAT for facilitating wireless connectivity in a localized area,such as a place of business, a home, a vehicle, a campus, and the like.In one embodiment, the base station 1414 b and the WTRUs 1402 c, 1402 dmay implement a radio technology such as IEEE 802.11 to establish awireless local area network (WLAN). In another embodiment, the basestation 1414 b and the WTRUs 1402 c, 1402 d may implement a radiotechnology such as IEEE 802.15 to establish a wireless personal areanetwork (WPAN). In yet another embodiment, the base station 1414 b andthe WTRUs 1402 c, 1402 d may utilize a cellular-based RAT (e.g., WCDMA,CDMA2000, GSM, LTE, LTE-A, etc.) to establish a picocell or femtocell.As shown in FIG. 14A, the base station 1414 b may have a directconnection to the Internet 1410. Thus, the base station 1414 b may notbe required to access the Internet 1410 via the core network1406/1407/1409.

The RAN 1403/1404/1405 may be in communication with the core network1406/1407/1409, which may be any type of network configured to providevoice, data, applications, and/or voice over internet protocol (VoIP)services to one or more of the WTRUs 1402 a, 1402 b, 1402 c, 1402 d. Forexample, the core network 1406/1407/1409 may provide call control,billing services, mobile location-based services, pre-paid calling,Internet connectivity, video distribution, etc., and/or performhigh-level security functions, such as user authentication. Although notshown in FIG. 14A, it will be appreciated that the RAN 1403/1404/1405and/or the core network 1406/1407/1409 may be in direct or indirectcommunication with other RANs that employ the same RAT as the RAN1403/1404/1405 or a different RAT. For example, in addition to beingconnected to the RAN 1403/1404/1405, which may be utilizing an E-UTRAradio technology, the core network 1406/1407/1409 may also be incommunication with another RAN (not shown) employing a GSM radiotechnology.

The core network 1406/1407/1409 may also serve as a gateway for theWTRUs 1402 a, 1402 b, 1402 c, 1402 d to access the PSTN 1408, theInternet 1410, and/or other networks 1412. The PSTN 1408 may includecircuit-switched telephone networks that provide plain old telephoneservice (POTS). The Internet 1410 may include a global system ofinterconnected computer networks and devices that use commoncommunication protocols, such as the transmission control protocol(TCP), user datagram protocol (UDP) and the internet protocol (IP) inthe TCP/IP internet protocol suite. The networks 1412 may include wiredor wireless communications networks owned and/or operated by otherservice providers. For example, the networks 1412 may include anothercore network connected to one or more RANs, which may employ the sameRAT as the RAN 1403/1404/1405 or a different RAT.

Some or all of the WTRUs 1402 a, 1402 b, 1402 c, 1402 d in thecommunications system 1400 may include multi-mode capabilities, e.g.,the WTRUs 1402 a, 1402 b, 1402 c, 1402 d may include multipletransceivers for communicating with different wireless networks overdifferent wireless links. For example, the WTRU 1402 c shown in FIG. 14Amay be configured to communicate with the base station 1414 a, which mayemploy a cellular-based radio technology, and with the base station 1414b, which may employ an IEEE 802 radio technology.

FIG. 14B is a system diagram of an example WTRU 1402. As shown in FIG.14B, the WTRU 1402 may include a processor 1418, a transceiver 1420, atransmit/receive element 1422, a speaker/microphone 1424, a keypad 1426,a display/touchpad 1428, non-removable memory 1430, removable memory1432, a power source 1434, a global positioning system (GPS) chipset1436, and other peripherals 1438. It will be appreciated that the WTRU1402 may include any sub-combination of the foregoing elements whileremaining consistent with an embodiment. Also, embodiments contemplatethat the base stations 1414 a and 1414 b, and/or the nodes that basestations 1414 a and 1414 b may represent, such as but not limited totransceiver station (BTS), a Node-B, a site controller, an access point(AP), a home node-B, an evolved home node-B (eNodeB), a home evolvednode-B (HeNB or HeNodeB), a home evolved node-B gateway, and proxynodes, among others, may include some or all of the elements depicted inFIG. 14B and described herein.

The processor 1418 may be a general purpose processor, a special purposeprocessor, a conventional processor, a digital signal processor (DSP), aplurality of microprocessors, one or more microprocessors in associationwith a DSP core, a controller, a microcontroller, Application SpecificIntegrated Circuits (ASICs), Field Programmable Gate Array (FPGAs)circuits, any other type of integrated circuit (IC), a state machine,and the like. The processor 1418 may perform signal coding, dataprocessing, power control, input/output processing, and/or any otherfunctionality that enables the WTRU 1402 to operate in a wirelessenvironment. The processor 1418 may be coupled to the transceiver 1420,which may be coupled to the transmit/receive element 1422. While FIG.14B depicts the processor 1418 and the transceiver 1420 as separatecomponents, it will be appreciated that the processor 1418 and thetransceiver 1420 may be integrated together in an electronic package orchip.

The transmit/receive element 1422 may be configured to transmit signalsto, or receive signals from, a base station (e.g., the base station 1414a) over the air interface 1415/1416/1417. For example, in oneembodiment, the transmit/receive element 1422 may be an antennaconfigured to transmit and/or receive RF signals. In another embodiment,the transmit/receive element 1422 may be an emitter/detector configuredto transmit and/or receive IR, UV, or visible light signals, forexample. In yet another embodiment, the transmit/receive element 1422may be configured to transmit and receive both RF and light signals. Itwill be appreciated that the transmit/receive element 1422 may beconfigured to transmit and/or receive any combination of wirelesssignals.

In addition, although the transmit/receive element 1422 is depicted inFIG. 14B as a single element, the WTRU 1402 may include any number oftransmit/receive elements 1422. More specifically, the WTRU 1402 mayemploy MIMO technology. Thus, in one embodiment, the WTRU 1402 mayinclude two or more transmit/receive elements 1422 (e.g., multipleantennas) for transmitting and receiving wireless signals over the airinterface 1415/1416/1417.

The transceiver 1420 may be configured to modulate the signals that areto be transmitted by the transmit/receive element 1422 and to demodulatethe signals that are received by the transmit/receive element 1422. Asnoted above, the WTRU 1402 may have multi-mode capabilities. Thus, thetransceiver 1420 may include multiple transceivers for enabling the WTRU1402 to communicate via multiple RATs, such as UTRA and IEEE 802.11, forexample.

The processor 1418 of the WTRU 1402 may be coupled to, and may receiveuser input data from, the speaker/microphone 1424, the keypad 1426,and/or the display/touchpad 1428 (e.g., a liquid crystal display (LCD)display unit or organic light-emitting diode (OLED) display unit). Theprocessor 1418 may also output user data to the speaker/microphone 1424,the keypad 1426, and/or the display/touchpad 1428. In addition, theprocessor 1418 may access information from, and store data in, any typeof suitable memory, such as the non-removable memory 1430 and/or theremovable memory 1432. The non-removable memory 1430 may includerandom-access memory (RAM), read-only memory (ROM), a hard disk, or anyother type of memory storage device. The removable memory 1432 mayinclude a subscriber identity module (SIM) card, a memory stick, asecure digital (SD) memory card, and the like. In other embodiments, theprocessor 1418 may access information from, and store data in, memorythat is not physically located on the WTRU 1402, such as on a server ora home computer (not shown).

The processor 1418 may receive power from the power source 1434, and maybe configured to distribute and/or control the power to the othercomponents in the WTRU 1402. The power source 1434 may be any suitabledevice for powering the WTRU 1402. For example, the power source 1434may include one or more dry cell batteries (e.g., nickel-cadmium (NiCd),nickel-zinc (NiZn), nickel metal hydride (NiMH), lithium-ion (Li-ion),etc.), solar cells, fuel cells, and the like.

The processor 1418 may also be coupled to the GPS chipset 1436, whichmay be configured to provide location information (e.g., longitude andlatitude) regarding the current location of the WTRU 1402. In additionto, or in lieu of, the information from the GPS chipset 1436, the WTRU1402 may receive location information over the air interface1415/1416/1417 from a base station (e.g., base stations 1414 a, 1414 b)and/or determine its location based on the timing of the signals beingreceived from two or more nearby base stations. It will be appreciatedthat the WTRU 1402 may acquire location information by way of anysuitable location-determination implementation while remainingconsistent with an embodiment.

The processor 1418 may further be coupled to other peripherals 1438,which may include one or more software and/or hardware modules thatprovide additional features, functionality and/or wired or wirelessconnectivity. For example, the peripherals 1438 may include anaccelerometer, an e-compass, a satellite transceiver, a digital camera(for photographs or video), a universal serial bus (USB) port, avibration device, a television transceiver, a hands free headset, aBluetooth® module, a frequency modulated (FM) radio unit, a digitalmusic player, a media player, a video game player module, an Internetbrowser, and the like.

FIG. 14C is a system diagram of the RAN 1403 and the core network 1406according to an embodiment. As noted above, the RAN 1403 may employ aUTRA radio technology to communicate with the WTRUs 1402 a, 1402 b, 1402c over the air interface 1415. The RAN 1403 may also be in communicationwith the core network 1406. As shown in FIG. 14C, the RAN 1403 mayinclude Node-Bs 1440 a, 1440 b, 1440 c, which may each include one ormore transceivers for communicating with the WTRUs 1402 a, 1402 b, 1402c over the air interface 1415. The Node-Bs 1440 a, 1440 b, 1440 c mayeach be associated with a particular cell (not shown) within the RAN1403. The RAN 1403 may also include RNCs 1442 a, 1442 b. It will beappreciated that the RAN 1403 may include any number of Node-Bs and RNCswhile remaining consistent with an embodiment.

As shown in FIG. 14C, the Node-Bs 1440 a, 1440 b may be in communicationwith the RNC 1442 a. Additionally, the Node-B 1440 c may be incommunication with the RNC 1442 b. The Node-Bs 1440 a, 1440 b, 1440 cmay communicate with the respective RNCs 1442 a, 1442 b via an Iubinterface. The RNCs 1442 a, 1442 b may be in communication with oneanother via an Iur interface. Each of the RNCs 1442 a, 1442 b may beconfigured to control the respective Node-Bs 1440 a, 1440 b, 1440 c towhich it is connected. In addition, each of the RNCs 1442 a, 1442 b maybe configured to carry out or support other functionality, such as outerloop power control, load control, admission control, packet scheduling,handover control, macrodiversity, security functions, data encryption,and the like.

The core network 1406 shown in FIG. 14C may include a media gateway(MGW) 1444, a mobile switching center (MSC) 1446, a serving GPRS supportnode (SGSN) 1448, and/or a gateway GPRS support node (GGSN) 1450. Whileeach of the foregoing elements are depicted as part of the core network1406, it will be appreciated that any one of these elements may be ownedand/or operated by an entity other than the core network operator.

The RNC 1442 a in the RAN 1403 may be connected to the MSC 1446 in thecore network 1406 via an IuCS interface. The MSC 1446 may be connectedto the MGW 1444. The MSC 1446 and the MGW 1444 may provide the WTRUs1402 a, 1402 b, 1402 c with access to circuit-switched networks, such asthe PSTN 1408, to facilitate communications between the WTRUs 1402 a,1402 b, 1402 c and traditional land-line communications devices.

The RNC 1442 a in the RAN 1403 may also be connected to the SGSN 1448 inthe core network 1406 via an IuPS interface. The SGSN 1448 may beconnected to the GGSN 1450. The SGSN 1448 and the GGSN 1450 may providethe WTRUs 1402 a, 1402 b, 1402 c with access to packet-switchednetworks, such as the Internet 1410, to facilitate communicationsbetween and the WTRUs 1402 a, 1402 b, 1402 c and IP-enabled devices.

As noted above, the core network 1406 may also be connected to thenetworks 1412, which may include other wired or wireless networks thatare owned and/or operated by other service providers.

FIG. 14D is a system diagram of the RAN 1404 and the core network 1407according to an embodiment. As noted above, the RAN 1404 may employ anE-UTRA radio technology to communicate with the WTRUs 1402 a, 1402 b,1402 c over the air interface 1416. The RAN 1404 may also be incommunication with the core network 1407.

The RAN 1404 may include eNode-Bs 1460 a, 1460 b, 1460 c, though it willbe appreciated that the RAN 1404 may include any number of eNode-Bswhile remaining consistent with an embodiment. The eNode-Bs 1460 a, 1460b, 1460 c may each include one or more transceivers for communicatingwith the WTRUs 1402 a, 1402 b, 1402 c over the air interface 1416. Inone embodiment, the eNode-Bs 1460 a, 1460 b, 1460 c may implement MIMOtechnology. Thus, the eNode-B 1460 a, for example, may use multipleantennas to transmit wireless signals to, and receive wireless signalsfrom, the WTRU 1402 a.

Each of the eNode-Bs 1460 a, 1460 b, 1460 c may be associated with aparticular cell (not shown) and may be configured to handle radioresource management decisions, handover decisions, scheduling of usersin the uplink and/or downlink, and the like. As shown in FIG. 14D, theeNode-Bs 1460 a, 1460 b, 1460 c may communicate with one another over anX2 interface.

The core network 1407 shown in FIG. 14D may include a mobilitymanagement gateway (MME) 1462, a serving gateway 1464, and a packet datanetwork (PDN) gateway 1466. While each of the foregoing elements aredepicted as part of the core network 1407, it will be appreciated thatany one of these elements may be owned and/or operated by an entityother than the core network operator.

The MME 1462 may be connected to each of the eNode-Bs 1460 a, 1460 b,1460 c in the RAN 1404 via an S1 interface and may serve as a controlnode. For example, the MME 1462 may be responsible for authenticatingusers of the WTRUs 1402 a, 1402 b, 1402 c, beareractivation/deactivation, selecting a particular serving gateway duringan initial attach of the WTRUs 1402 a, 1402 b, 1402 c, and the like. TheMME 1462 may also provide a control plane function for switching betweenthe RAN 1404 and other RANs (not shown) that employ other radiotechnologies, such as GSM or WCDMA.

The serving gateway 1464 may be connected to each of the eNode-Bs 1460a, 1460 b, 1460 c in the RAN 1404 via the S1 interface. The servinggateway 1464 may generally route and forward user data packets to/fromthe WTRUs 1402 a, 1402 b, 1402 c. The serving gateway 1464 may alsoperform other functions, such as anchoring user planes duringinter-eNode B handovers, triggering paging when downlink data isavailable for the WTRUs 1402 a, 1402 b, 1402 c, managing and storingcontexts of the WTRUs 1402 a, 1402 b, 1402 c, and the like.

The serving gateway 1464 may also be connected to the PDN gateway 1466,which may provide the WTRUs 1402 a, 1402 b, 1402 c with access topacket-switched networks, such as the Internet 1410, to facilitatecommunications between the WTRUs 1402 a, 1402 b, 1402 c and IP-enableddevices.

The core network 1407 may facilitate communications with other networks.For example, the core network 1407 may provide the WTRUs 1402 a, 1402 b,1402 c with access to circuit-switched networks, such as the PSTN 1408,to facilitate communications between the WTRUs 1402 a, 1402 b, 1402 cand traditional land-line communications devices. For example, the corenetwork 1407 may include, or may communicate with, an IP gateway (e.g.,an IP multimedia subsystem (IMS) server) that serves as an interfacebetween the core network 1407 and the PSTN 1408. In addition, the corenetwork 1407 may provide the WTRUs 1402 a, 1402 b, 1402 c with access tothe networks 1412, which may include other wired or wireless networksthat are owned and/or operated by other service providers.

FIG. 14E is a system diagram of the RAN 1405 and the core network 1409according to an embodiment. The RAN 1405 may be an access servicenetwork (ASN) that employs IEEE 802.16 radio technology to communicatewith the WTRUs 1402 a, 1402 b, 1402 c over the air interface 1417. Aswill be further discussed below, the communication links between thedifferent functional entities of the WTRUs 1402 a, 1402 b, 1402 c, theRAN 1405, and the core network 1409 may be defined as reference points.

As shown in FIG. 14E, the RAN 1405 may include base stations 1480 a,1480 b, 1480 c, and an ASN gateway 1482, though it will be appreciatedthat the RAN 1405 may include any number of base stations and ASNgateways while remaining consistent with an embodiment. The basestations 1480 a, 1480 b, 1480 c may each be associated with a particularcell (not shown) in the RAN 1405 and may each include one or moretransceivers for communicating with the WTRUs 1402 a, 1402 b, 1402 cover the air interface 1417. In one embodiment, the base stations 1480a, 1480 b, 1480 c may implement MIMO technology. Thus, the base station1480 a, for example, may use multiple antennas to transmit wirelesssignals to, and receive wireless signals from, the WTRU 1402 a. The basestations 1480 a, 1480 b, 1480 c may also provide mobility managementfunctions, such as handoff triggering, tunnel establishment, radioresource management, traffic classification, quality of service (QoS)policy enforcement, and the like. The ASN gateway 1482 may serve as atraffic aggregation point and may be responsible for paging, caching ofsubscriber profiles, routing to the core network 1409, and the like.

The air interface 1417 between the WTRUs 1402 a, 1402 b, 1402 c and theRAN 1405 may be defined as an R1 reference point that implements theIEEE 802.16 specification. In addition, each of the WTRUs 1402 a, 1402b, 1402 c may establish a logical interface (not shown) with the corenetwork 1409. The logical interface between the WTRUs 1402 a, 1402 b,1402 c and the core network 1409 may be defined as an R2 referencepoint, which may be used for authentication, authorization, IP hostconfiguration management, and/or mobility management.

The communication link between each of the base stations 1480 a, 1480 b,1480 c may be defined as an R8 reference point that includes protocolsfor facilitating WTRU handovers and the transfer of data between basestations. The communication link between the base stations 1480 a, 1480b, 1480 c and the ASN gateway 1482 may be defined as an R6 referencepoint. The R6 reference point may include protocols for facilitatingmobility management based on mobility events associated with each of theWTRUs 1402 a, 1402 b, 1402 c.

As shown in FIG. 14E, the RAN 1405 may be connected to the core network1409. The communication link between the RAN 1405 and the core network1409 may defined as an R3 reference point that includes protocols forfacilitating data transfer and mobility management capabilities, forexample. The core network 1409 may include a mobile IP home agent(MIP-HA) 1484, an authentication, authorization, accounting (AAA) server1486, and a gateway 1488. While each of the foregoing elements aredepicted as part of the core network 1409, it will be appreciated thatany one of these elements may be owned and/or operated by an entityother than the core network operator.

The MIP-HA may be responsible for IP address management, and may enablethe WTRUs 1402 a, 1402 b, 1402 c to roam between different ASNs and/ordifferent core networks. The MIP-HA 1484 may provide the WTRUs 1402 a,1402 b, 1402 c with access to packet-switched networks, such as theInternet 1410, to facilitate communications between the WTRUs 1402 a,1402 b, 1402 c and IP-enabled devices. The AAA server 1486 may beresponsible for user authentication and for supporting user services.The gateway 1488 may facilitate interworking with other networks. Forexample, the gateway 1488 may provide the WTRUs 1402 a, 1402 b, 1402 cwith access to circuit-switched networks, such as the PSTN 1408, tofacilitate communications between the WTRUs 1402 a, 1402 b, 1402 c andtraditional land-line communications devices. In addition, the gateway1488 may provide the WTRUs 1402 a, 1402 b, 1402 c with access to thenetworks 1412, which may include other wired or wireless networks thatare owned and/or operated by other service providers.

Although not shown in FIG. 14E, it will be appreciated that the RAN 1405may be connected to other ASNs and the core network 1409 may beconnected to other core networks. The communication link between the RAN1405 the other ASNs may be defined as an R4 reference point, which mayinclude protocols for coordinating the mobility of the WTRUs 1402 a,1402 b, 1402 c between the RAN 1405 and the other ASNs. Thecommunication link between the core network 1409 and the other corenetworks may be defined as an R5 reference, which may include protocolsfor facilitating interworking between home core networks and visitedcore networks.

The processes and instrumentalities described herein may apply in anycombination, may apply to other wireless technologies, and for otherservices.

A WTRU may refer to an identity of the physical device, or to the user'sidentity such as subscription related identities, e.g., MSISDN, SIP URI,etc. WTRU may refer to application-based identities, e.g., user namesthat may be used per application.

The processes described above may be implemented in a computer program,software, and/or firmware incorporated in a computer-readable medium forexecution by a computer and/or processor. Examples of computer-readablemedia include, but are not limited to, electronic signals (transmittedover wired and/or wireless connections) and/or computer-readable storagemedia. Examples of computer-readable storage media include, but are notlimited to, a read only memory (ROM), a random access memory (RAM), aregister, cache memory, semiconductor memory devices, magnetic mediasuch as, but not limited to, internal hard disks and removable disks,magneto-optical media, and/or optical media such as CD-ROM disks, and/ordigital versatile disks (DVDs). A processor in association with softwaremay be used to implement a radio frequency transceiver for use in aWTRU, UE, terminal, base station, RNC, and/or any host computer.

What is claimed is:
 1. An apparatus for palette decoding video data, theapparatus comprising: a processor configured to: obtain a palette tablecomprising a plurality of color indices, wherein the plurality of colorindices corresponds to respective colors of a plurality of major colors;obtain palette index prediction data comprising a first run value dataand a second run value data, wherein the first run value data isconfigured to represent at least two consecutive pixels in a paletteindex map having a same color index, and wherein the second run valuedata is configured to represent at least two consecutive pixels in thepalette index map having an escape color index; and reconstruct one ormore pixels of a coding block based on the palette table and the paletteindex prediction data.
 2. The apparatus of claim 1, wherein the paletteindex map associates a pixel of the video data with a color index in thepalette table if a color of the pixel is associated with a major color,and the palette index map associates the pixel of the video data withthe escape color index if the color of the pixel is not associated witha major color.
 3. The apparatus of claim 1, wherein the escape colorindex is greater than a maximum color index of the plurality of colorindices of the palette table, and wherein the escape color indexcorresponds to a size of the palette table.
 4. The apparatus of claim 1,wherein the first run value data and the second run value data areconfigured to indicate a number of consecutive pixels to be decodedusing at least one of a run mode or a copy mode, and at least one pixelof the consecutive pixels is decoded using the escape color index. 5.The apparatus of claim 1, wherein the first run value data and thesecond run value data are configured to indicate a number of consecutivepixels, wherein at least one pixel of the consecutive pixels is decodedusing the escape color index, and wherein escape color values aredecoded for each of the at least one pixel of the consecutive pixels. 6.A non-transitory computer readable medium including instructions forpalette decoding video data, the instructions causing a processor toperform: obtaining a palette table comprising a plurality of colorindices, wherein the plurality of color indices corresponds torespective colors of a plurality of major colors; obtaining paletteindex prediction data comprising a first run value data and a second runvalue data, wherein the first run value data is configured to representat least two consecutive pixels in a palette index map, and wherein thesecond run value data is configured to represent at least twoconsecutive pixels in the palette index map having an escape colorindex; and reconstructing one or more pixels of a coding block based onthe palette table and the palette index prediction data.
 7. Thenon-transitory computer readable medium of claim 6, wherein the paletteindex map associates a pixel of the video data with a color index in thepalette table if a color of the pixel is associated with a major color,and the palette index map associates the pixel of the video data withthe escape color index if the color of the pixel is not associated witha major color.
 8. The non-transitory computer readable medium of claim6, wherein the escape color index is greater than a maximum color indexof the plurality of color indices of the palette table, and wherein theescape color index corresponds to a size of the palette table.
 9. Thenon-transitory computer readable medium of claim 6, wherein the firstrun value data and the second run value data are configured to indicatea number of consecutive pixels to be decoded using at least one of a runmode or a copy mode, and at least one pixel of the consecutive pixels isdecoded using the escape color index.
 10. The non-transitory computerreadable medium of claim 6, wherein the first run value data and thesecond run value data are configured to indicate a number of consecutivepixels, wherein at least one pixel of the consecutive pixels is decodedusing the escape color index, and wherein escape color values aredecoded for each of the at least one pixel of the consecutive pixels.11. A non-transitory computer readable medium including instructions forpalette decoding video data, the instructions causing a processor toperform: obtaining a palette table comprising a plurality of colorindices corresponding to respective colors of a plurality of colors;obtaining palette index map parameters, the palette index map parametersrepresenting a series of color indices that comprises an escape colorindex mapping one or more pixels of a coding block to an escape colormode; determining, based on the palette index map parameters, the one ormore pixels of the coding block that are mapped by a palette index mapto the escape color mode; obtaining escape color parameters thatindicate at least one escape color value for the one or more pixels ofthe coding block mapped to the escape color mode after obtaining thepalette index map parameters for the coding block; and reconstructingthe coding block based on the obtained palette index map parameters andthe obtained escape color parameters.
 12. The non-transitory computerreadable medium of claim 11, wherein the series of color indicescomprises a color index mapping one or more pixels of the coding blockto a major color of the palette table.
 13. The non-transitory computerreadable medium of claim 11, wherein colors for the one or more pixelsof the coding block that are mapped by the palette index map to theescape color mode are reconstructed based on the obtained escape colorparameters.
 14. A non-transitory computer readable medium includingvideo data generated, the video data comprising: a palette tablecomprising a plurality of color indices corresponding to respectivecolors of a plurality of colors; a palette index map for a coding block,the palette index map comprising a series of color indices, each of thecolor indices of the series corresponding to at least one of theplurality of color indices in the palette table or an escape color indexindicative of an escape color mode, the series of color indicesselectively mapping pixels of the coding block to major colors or to theescape color mode; palette index map parameters representing the seriesof color indices of the palette index map for the coding block; andescape color parameters indicating escape color values for pixels of thecoding block mapped to the escape color mode after the palette index mapparameters.
 15. The non-transitory computer readable medium of claim 14,wherein the escape color index is greater than a maximum color index ofthe plurality of color indices of the palette table.
 16. Thenon-transitory computer readable medium of claim 14, wherein the escapecolor index corresponds to a size of the palette table.
 17. A methodcomprising: obtaining a palette table comprising a plurality of colorindices, wherein the plurality of color indices corresponds torespective colors of a plurality of major colors; obtaining paletteindex prediction data comprising a first run value data and a second runvalue data, wherein the first run value data is configured to representat least two consecutive pixels in a palette index map, and wherein thesecond run value data is configured to represent at least twoconsecutive pixels in the palette index map having an escape colorindex; and reconstructing one or more pixels of a coding block based onthe palette table and the palette index prediction data.
 18. The methodof claim 17, wherein the palette index map associates a pixel of videodata with a color index in the palette table if a color of the pixel isassociated with a major color, and the palette index map associates thepixel of the video data with the escape color index if the color of thepixel is not associated with a major color.
 19. The method of claim 17,wherein the escape color index is greater than a maximum color index ofthe plurality of color indices of the palette table, and wherein theescape color index corresponds to a size of the palette table.
 20. Themethod of claim 17, wherein the first run value data and the second runvalue data are configured to indicate a number of consecutive pixels tobe decoded using at least one of a run mode or a copy mode, and at leastone pixel of the consecutive pixels is decoded using the escape colorindex.
 21. An apparatus comprising: a processor configured to: produce apalette table comprising a plurality of color indices corresponding torespective colors of a plurality of colors; obtain a palette index mapfor a coding unit; include the palette table in video data; includepalette index map parameters in the video data, wherein the paletteindex map parameters represent a series of color indices of the paletteindex map for the coding unit; and include escape color parameters inthe video data after the palette index map parameters, wherein theescape color parameters indicate escape color values for pixels of thecoding unit mapped to an escape color mode.
 22. The apparatus of claim21, wherein the palette index map comprises the series of color indices,wherein each of the color indices of the series is taken from at leastone of the plurality of color indices in the palette table or an escapecolor index.
 23. The apparatus of claim 22, wherein the escape colorindex is indicative of the escape color mode, wherein the escape colorindex is greater than a maximum color index of the plurality of colorindices of the palette table, wherein the escape color index correspondsto a size of the palette table, and wherein the series of color indicesselectively map pixels of the coding unit to major colors or to theescape color mode.
 24. A non-transitory computer readable storage mediumstoring instructions, the instructions configuring a processor toperform: producing a palette table comprising a plurality of colorindices corresponding to respective colors of a plurality of colors;obtaining a palette index map for a coding unit; including the palettetable in video data; including palette index map parameters in the videodata, wherein the palette index map parameters represent a series ofcolor indices of the palette index map for the coding unit; andincluding escape color parameters in the video data after the paletteindex map parameters, wherein the escape color parameters indicateescape color values for pixels of the coding unit mapped to an escapecolor mode.
 25. The non-transitory computer readable storage medium ofclaim 24, wherein the palette index map comprises the series of colorindices, wherein each of the color indices of the series is taken fromat least one of the plurality of color indices in the palette table oran escape color index, wherein the escape color index is indicative ofthe escape color mode, wherein the escape color index is greater than amaximum color index of the plurality of color indices of the palettetable, wherein the escape color index corresponds to a size of thepalette table, and wherein the series of color indices selectively mappixels of the coding unit to major colors or to the escape color mode.